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ABSTRACT 

The United States Training and Employment Service 
General Aptitude Test Battery (GATB), first published in 1947, has 
been included in a continuing program of research to validate the 
tests against success in many different occupations. The GATB 
consists of 12 tests which measure nine aptitudes: General Learning 
Ability; Verbal Aptitude; Numerical Aptitude; Spatial Aptitude; Form 
Perception; Clerical Perception; Motor Coordination; Finger 
Dexterity; and Manual Dexterity. The aptitude scores are standard 
scores with 100 as the average for the general working population, 
and a standard deviation of 20. Occupational norms are established in 
terms of minimum qualifying scores for each of the significant 
aptitude measures which, when combined, predict job performance. 
Cutting scores are set only for those aptitudes which aid in 
predicting the performance of the job duties of the experimental 
sample. The GATB norms described are appropriate only for jobs with 
content similar to that shown in the job description presented in 
this report. A description of the validation sample and a personnel 
evaluation form are also included. (AG) 
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FOREWORD 

The United States Training and Employment Service General Aptitude Test 
Battery (GATB) was first published in 19JU7. Since that time the GA.TB 
has been included in a continuing program of research to validate the 
tests against success in many different occupations* Because of its 
extensive research base the GATB has come to be recognized as the best 
validated multiple aptitude test battery in existence for use in vocational 
guidance* 

The GATB consists of 12 tests which measure 9 aptitudes: General Learning 

Ability, Verbal Aptitude, Numerical Aptitude, Spatial Aptitude, Form Per- 
ception, Clerical Perception, Motor Coordination, Finger Dexterity, and 
Manual Dexterity. .. The aptitude scores are standard scores with 100 as the 
average for the general working population, with a standard deviation of 
20 . 

Occupational norms are established in terms of minimum qualifying scores 
for each of the significant aptitude measures which, in combination, 
predict job performance. For any given occupation, cutting scores are 
set only for those aptitudes which contribute to the prediction of per- 
formance of the job duties of the experimental sample. It is important 
to recognize that another job might have the same job title but the job 
content might not be similar. The GATB noims described in this report are 
appropriate for use only for jobs with content similar to that shown in 
the job description included in this report. 
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-1-' GATB-2783 

DEVELOPMENT OF USTES APTITUDE TEST BATTERY 

For 

Programmer, Detail, Graphic Arts (clerical! 219.388-206 



This report describes the research undertaken for the purpose of developing 
General Aptitude Test Battery (GATB) norms for the occupation of Programmer, 
Detail Graphic Arts (clerical) 219.388-206. The following norms were 
established: 





Minimum Acceptable 


GATB Aptitudes 


GATB Scores 


- Numerical Aptitude 


95 


- Spatial Aptitude 


85 


- Motor Coordination 


85 



Research Summary 



Sample : 

60 trainees (58 males and 2 females) from various printing firms in the United 
States and Canada who were enrolled in a six-week Computer Programming 
and Operation course at the ITU Training Center in Colorado Springs, Colorado 
This study was conducted prior to the Colorado agency receiving permission to 
collect minority group information. Therefore, minority group composition is 
unknown. 

Criterion: 

Instructor's descriptive rating scale for trainees. 

Design : 

Longitudinal tests were administered during the initial phases and criterion 
data were not obtained until completion of training . 

Minimum aptitude requirements were determined on the basis of job analysis, 
and statistical analyses of aptitude mean scores, standard deviations, apti- 
tude-criterion correlations, and selective efficiencies. 
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Predictive Validity: 

Phi Coefficient = .49 (P/2^.0005) 
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Effectiveness of Norms : 

Only 67% of the non-test-selected trainees used for this study were good 
trainees; if the trainees had been test-selected with the above norms, 80% 
would have been good trainees. 33% of the non-test-selected trainees 
used for this study were poor trainees; if the trainees had been test- 
selected with the above norms, only 20% would have been poor trainees. 

The effectiveness of the norms is shown graphically in Table 1; 

TABLE 1 

Effectiveness of Norms 

Without Tests With Tests 
Good Trainees 67% 80% 

Poor Trainees 33% 20 % 

Sample Description 

Size: 

N = 60 

O ccupational Status : 

ITU members employed as craftsmen in the printing and publishing industry 
who were in training to become detail programmers . 

Work Setting : 

Subjects were enrolled in a six-week computer programming and operation 
program at the ITU Training Center in Colorado Springs, Colorado. 

Selection Requirements : 

Age: No requirement 
Education: No requirement 

Tests: None 

Previous Experience: No requirement 

Other: ITU members who would attend the training on their own time and pay 
their own expenses or who were sent by their employer at his expense. 

P rincipal Activities: 

The job duties for each worker are comparable to those shown in the Fact Sheet 
9 in the Appendix. 

ERIC 5 



Minimum Experience: 

All trainees were tested during the initial phase of training. None had any 
previous experience in detail programming. 

TABLE 2 

Means, Standard Deviations (SD) , Ranges, and 
Pearson Product^ Moment Correlations with the 
Criterion (r) for Age and Education 





Mean 


SD 


Range 


r 


Age (years) 


37.4 


9.1 


23-65 


-.404** 


Education (years) 


12.3 


1.4 


8-16 


.295* 



♦♦Significant at the .01 level 
* Significant at the .05 level 

Experimental Test Battery 

All twelve tests of the GATB, B-1002A or B were administered to the validation 
sample during the period July 1967 through January 1969. 

Criterion • 

The criterion data consisted of Instructor's Descriptive Rating Scale for 
Trainees obtained after the subject had completed the training. Trainee per- 
formance ratings were collected between December 1967 and January 1970. 

One composite rating was obtained for each trainee covering the various 
duties of the program. 

Rating Scale: 

An adaptation of USTES Form SP-21T, Descriptive Rating Scale for Trainees 
(see appendix) . The scale consists of eight items covering different aspects 
of training performance with five alternatives for each item. 

Reliability: 

Only one rating was obtained for the subjects, therefore, a reliability co- 
efficient was not obtained. 



O 



6 



-4- 

Olterion Score Distribution : 

Possible range : 

Actual range : 

Mean : 

Standard Deviation: 

Criterion Dichotomy: 

The criterion distribution was dichotomized into high and low groups by placing 
33% of the sample in the low criterion group to correspond with the percentage 
of trainees considered marginal or unsatisfactory. Trainees in the high criterion 
group were designated as "good trainees" and those in the low criterion group 
as "poor trainees." The critical criterion score is 22. 

Aptitudes Considered for Inclusion in the Norms 

Aptitudes were selected for tryout on the basis of a qualitative analysis of 
job duties involved and a statistical analysis of test and criterion data. 

Aptitude Q was included because it was rated important to the job duties and 
because the sample had a relatively high mean score on this aptitude. Tables 
3, 4 and 5 show the results of the qualitative and statistical analyses. 

i“" • • ■ 

TABLE 3 

Qualitative Analysis 

(Based on the job description and observation of the job, the aptitudes indi- 
cated appear to be important to the work performed.) 

Rationale 



Necessary to become familiar with and under- 
stand the capabilities and limitations of a 
computer and adapt those principles by which 
the machine operates, thus facilitating the 
most efficient and effective method of pro- 
cessing data. 

Necessary to read, understand, and confer with 
supervisors and representatives of departments 
regarding data pertinent to programming , as well 
as programming for effective production of words , 
sentences, and parag. t. phs. 



Aptitude 

G - General Learning Ability 



V - Verbal Ability 



8 - 40 
8-40 
24. 9 
7.5 
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N - Numerical Aptitude 



S - Spatial Aptitude 



P - Form Perception 



Q ~ Clerical Perception 



K - Motor Coordination 



Necessary to understand and reason mathema- 
tical operations quickly and accurately, to 
reason quantitatively . To be able to arrange 
computations into proper program sequence for 
computer operations. 

Necessary to develop and interpret flow charts 
and diagrams; and to visualize flow of data 
through the computer system. 

Necessary to perceive pertinent detail in the 
programming process as well as the final pro- 
duct, make visual comparisons and discrimina- 
tions and see differences in shapes and shadings 
of figures and widths and lengths of lines. 

Necessary to perceive pertinent detail in pro- 
gram documentation, assembled data and recom- 
mended program routine, and recognize and 
detect errors in instructions, etc. 

Necessary to coordinate eyes and hands or fingers 
accurately to prepare and complete flow charts. 



TABLE 4 
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Means, Standard Deviations (SD) , Ranges, and Pearson 
Product-Moment Correlations with the Criterion (r) for 
the Aptitudes of the GATB. 



Aptitude 

G - General Learning Ability 
V - Verbal Aptitude 
N - Numerical Aptitude 
S - Spatial Aptitude 
P - Form Perception 
Q - Clerical Perception 
K - Motor Coordination 
F - Finger Dexterity 
M- Manual Dexterity 

* Significat at the .05 level. 
**Significant at the .01 level. 



N = 60 








Mean 


SD 


Range 


r 


116.9 


17.0 


76-151 


.515** 


113.3 


14.8 


78-147 


.284* 


114.2 


18.2 


72-155 


.424** 


112.9 


18.9 


65-160 


.401** 


112.4 


19.3 


68-166 


.253 


126.7 


19.7 


78-194 


.197 


105.5 


16.3 


66-153 


.271* 


100.5 


19.8 


55-149 


.195 


111.3 


17.6 


69-157 


.275* 
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TABLE 5 

Summary of Qualitative and Quantitative Data 
Type of Evidence Aptitudes 



Job Analysis Data; 

Tmnnrtant 


X 


X 


X 


X X 


X 


X 




Trr^l pvant — 


Relatively High Means 


X 




X 




X 






Relatively Low Standard Deviations 




X 












Sianificant Correlation with Criterion 


X 


X 


X 


X 




X 


X 


ADtitudes to be considered for Trial Norms 


G 


V 


N 


s 


_Q_ 


K 


M 



Deviation and Validity of Norms 



Final norms were derived on the basis of a comparison of the degree to which 
trial norms consisting of various combinations of Aptitudes N, S, and K at 
trial cutting scores were able to differentiate between the 67% of the sample 
considered good trainees and the 33% considered poor trainees. Trial cutting 
scores at the five point interval nearest to one standard deviation below the 
mean for each aptitude are tried because this will eliminate about one-third 
of the sample with three-aptitude norms. For two-aptitude norms, minimum 
cutting scores slightly higher than one standard deviation below the mean will 
eliminate about one-third of the sample; for four-aptitude trial norms, cutting 
scores of slightly lower than one standard deviation below the mean will 
eliminate about one-third of the sample. The Phi Coefficient was used as a 
basis for comparing trial norms. Norms of N-95, S-85 and K-85 provided 
optimum differentiation for the occupation of Programmer, Detail (graphic arts) 
(clerical) 219.388-206. The validity of the norms is shown in Table 6 and is 
indicated by a Phi Coefficient of .49 (statistically significant at the .0005 
level) „ 




TABLE 6 



Predictive Validity of Test Norms, N-95, S-85, and K— 85 





Nonqualifying 
Test Scores 


Qualifying 
Test Scores 


Total 


Good Trainees 


3 


37 


40 


Poor Trainees 


11 


9 


20 


Total 


14 


46 


60 



Chi Square (X?y) =14.3 



Phi Coefficient (0) = .49 
Significance Level = P/2 <.0005 
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Determination of Occupational Aptitude Pattern 

The data for this study met the requirements for incorporating the occupation 
studied into QAP-38 which is shown in the 1970 edition of Section II of the 
Manual for the General Aptitude Test Battery . A Phi Coefficient of .fcl Is 
obtained with the QAP-38 norms of N-80, S-85, and K-80. 
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APPENDIX 
RATING TRAINEES 
DESCRIPTIVE RATING SCALE 



(For Aptitude Test Development Studies) 



Score 



RATING SCALE FOR 



(DOT Title and Code for Training Course) 



Directions: Please read "RATING TRAINEES - SUGGESTIONS To RATERS" 

and then complete this rating scale. In making your 
ratings , only one box should be checked for each 
question. 



Name of trainee (print) 



(Last) 






Sex: Male 



Female 



INFORMATION TO BE PROVIDED BT RATER 



RATED BT a , 

TITLE 

LOCATION OF TRAINING DATE 

(City) (State) 
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A. How much aptitude or facility does he have for the vocational training? 

(Trainee* s adeptness or knack for performing the work easily and well.) 

CZ3 1. Has great difficulty doing the work. Not at all suited for the training. 
CUD 2. Usually has some difficulty doing the work. Not too well suited for the 
training. 

t— □ 3* Does the work without too much difficulty. Fairly well suited for the 
training. 

=3 4. Usually does the work without difficulty. Well suited for the training. 
E=l 5* Does the work with great ease. Exceptionally well suited for the training. 



B. How much ability does he have for maintaining adequate production in the vocational 
activity for which he was trained? 

j — — t 1. Capable cf very low work output. Can perform only at an unsatisfactory pace. 
t= 2. Capable of low work output. Can perform at a slow pace. 

J J 3* Capable of fair work output. Can perform at an acceptable but not a fast pace 

l — I 4. Capable of high work output. Can perform at a fast pace. 

I 3 5* Capable of very high work output. Can perform at an unusually fast pace* 



C. How good was the quality of his work during the vocational training? 

J — J !• Performance was inferior and almost never met minimum quality standards. 

J — * 2. Performance was usually acceptable but somewhat inferior in quality. The 
grade of his work could stand improvement. 

1 — f 3* Performance was acceptable but usually not superior in quality. 

I — ) 4. Performance was usually superior in quality. 

J — I 5* Performance was almost always of the highest quality. 



D. How quickly did he learn the instructional units of the vocational training? 

I \ 1. Learned the work very slowly. Needed careful and repeated instructions. 

l — J 2. Learned the work somewhat slower than most. 

L— I 3* Learned most of the work in the usual amount of time. 

I — I 4. Learned most of the work quickly. 

1 — I 5* Learned all of the work very rapidly. Needed only the minimum amount of 
training or instructions for even the difficult aspects. 



E. How much ability does he have for using the equipment of the vocational training? 



cm 1. 
1=1 2 . 
1 = 13 . 
=J 4. 
= 5. 



Has very limited ability. Cannot use the equipment adequately. 

Has little ability. Can use the equipment to "get by." 

Has a moderate amount of ability. Can use the equipment to do fair work. 
Has high ability. Can use the equipment to do good work. 

Has very high ability. Can use the equipment to do excellent work. 
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F. How large a variety of job duties can he perform efficiently? 

j 1 1* Cannot perform different operations adequately. 

j 1 2. Can perform a limited number of different operations efficiently. 

j — j 3. Can perform several different operations with reasonable efficiency. 
j 1 Can perform many different operations efficiently. 

1 1 5* Can perform an unusually large variety of different operations efficiently. 



G. How resourceful is he in coping with work situations that are different or out 
of the ordinary? 

CZZI 1. Almost never is able to figure out what to do. Needs help on even minor 
problems. 

1 1 2. Often has difficulty handling new situations. Needs help on all but 

simple problems. 

1 * 3. Sometimes knows what to do, sometimes doesn't. Can deal with problems that 

are not too complex. 

| * Usually able to handle new situations. Needs help on only complex problems. 

*— 1 5. Practically always figures out what to do himself. Rarely needs help, 
even on complex problems# 



H. Considering all the factors already rated, and only these factors, how acceptable 
was his performance during vocational training? 

I 1 1. Performance was unsatisfactory. ' 

j 1 2. Performance was not completely satisfactory. 

| 1 3« Performance was satisfactory. 

1 I 4. Performance was good. 

I 1 5. Performance was outstanding. 
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S-450 



Job Title: 

Job Summary: 

Work Performed: 



Effectiveness of- 
Norms : 

Applicability of 
S-450 Norms : 



FACT SHEET 

Programmer, Detail, (Graphic Arts) , (clerical) 219.388-206 

Prepares program low charts or decision tables as required. 
Writes the programs within the graphic arts industry and de- 
velops operation requirements. May also be required to be 
capable of business application programming. 

Adapts presently available EDP manufacturers' programs, as 
needed to permit a conversion from hot-metal typesetting to 
cold type, using knowledge of programming techniques to 
modify manufacturers' available typesetting programs to the 
specific needs of the using establishment. Must be knowl- 
edgeable of various phases of the program in order to enter 
changes in column width, indentation, punctuation, and over- 
all format. 

Must be capable of conferring with supervisors and represen- 
tatives of department (s) such as the graphic arts, circulation, 
advertising, etc. to verify program concepts , output require- 
ments, input media, and internal checks and audits. Capa- 
bility to analyze work flow charts, decision tables or diagram 
representing specific function by applying knowledge of com- 
puter capabilities and subject matter to develop sequence of 
program steps. Converts written statements of functions to 
detailed logical flow charts or decision tables as required for 
coding into computer language peculiar to make or model of the 
computer, to develop successive steps necessary to complete 
the program for machine processable instructions, Marks code 
sheets to indicate relationship of code to program. Must be 
capable of debugging and testing the program to meet system 
requirements prior to production status and to provide complete 
detail program documentation and operating instructions. 

In addition to the above it will be necessary to be capable of 
operating the equipment. 

Only 67% of the non-test'-selected trainees used for this study 
were good trainees; if the trainees had been test-selected with 
the S-450 norms, 80% would have been good trainees. 33% of 
non-test-selected trainees used for this study were poor 
trainees; if the trainees had been test-selected with the S-450 
norms, only 20% would have been poor trainees. 

The aptitude test battery is applicable to training stituations which 
include most of the training described above or to entry on jobs 
similar to the above job description. 

GPO • *9 8.0 19 



O 



14 



U.S. DEPARTMENT OF LABOR 

MANPOWER ADMINISTRATION 

WASHINGTON. D.C. 20210 

OFFICIAL BUSINESS 



POSTAGE AND FEES PAID 

U.S. DEPARTMENT OF LABOR 

i 

I THIRD CLASS MAIL 

I. 




*t.NT 0 , 



c 

lr: 

<4. 



i 



\ 



*c 

:U 









017 E> 

!x>am<T si»>ra 



if 



tOf 41 ■ t*4*l 



